Chapter 2 



Go with the flow 



Dynamical systems theory includes an extensive body of 
knowledge about qualitative properties of generic smooth 
families of vector fields and discrete maps. The theory 
characterizes structurally stable invariant sets [...] The 
logic of dynamical systems theory is subtle. The theory 
abandons the goal of describing the qualitative dynamics 
of all systems as hopeless and instead restricts its atten- 
tion to phenomena that are found in selected systems. The 
subtlety comes in specifying the systems of interest and 
which dynamical phenomena are to be analyzed. 

— John Guckenheimer 

(R. Mainieri, P. Cvitanovic and E.A. Spiegel) 



WE DEFINE a dynamical system (M, f) and classify its solutions as equilibria, 
periodic, and aperiodic. An 'aperiodic' solution is either 'wandering' or 
belongs to a non-wandering set, which in turn can be decomposed into 
into chain-recurrent sets. Various cases are illustrated with concrete examples, 
such as the Rossler and Lorenz systems. 




fast track: 
chapter 16, p. 327 



2.1 Dynamical systems 



In a dynamical system we observe the world as it evolves with time. We express 
our observations as numbers and record how they change; given sufficiently de- 
tailed information and understanding of the underlying natural laws, we see the 
future in the present as in a mirror. The motion of the planets against the celestial section 1 .3 
firmament provides an example. Against the daily motion of the stars from East 
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f'(x) 



Figure 2.1: A trajectory traced out by the evolution 
rule /'. Starting from the state space point x, after a 
time t, the point is at f'(x). 




to West, the planets distinguish themselves by moving among the fixed stars. An- 
cients discovered that by knowing a sequence of planet's positions-latitudes and 
longitudes-its future position could be predicted. 

For the solar system, tracking the latitude and longitude in the celestial sphere 
suffices to completely specify the planet's apparent motion. All possible values for 
positions and velocities of the planets form the phase space of the system. More 
generally, a state of a physical system, at a given instant in time, can be represented 
by a single point in an abstract space called state space M (mnemonic: curly 'Al' 
for a 'manifold'). As the system changes, so does the representative point in state 
space. We refer to the evolution of such points as dynamics, and the function /' 
which specifies where the representative point is at time t as the evolution rule. remark 2.1 

If there is a definite rule / that tells us how this representative point moves in 
M, the system is said to be deterministic. For a deterministic dynamical system, 
the evolution rule takes one point of the state space and maps it into exactly one 
point. However, this is not always possible. For example, knowing the tempera- 
ture today is not enough to predict the temperature tomorrow; knowing the value 
of a stock today will not determine its value tomorrow. The state space can be en- 
larged, in the hope that in a sufficiently large state space it is possible to determine 
an evolution rule, so we imagine that knowing the state of the atmosphere, mea- 
sured over many points over the entire planet should be sufficient to determine the 
temperature tomorrow. Even that is not quite true, and we are less hopeful when 
it comes to stocks. 

For a deterministic system almost every point has a unique future, so trajecto- 
ries cannot intersect. We say 'almost' because there might exist a set of measure 
zero (tips of wedges, cusps, etc.) for which a trajectory is not defined. We may chapter 12 
think such sets a nuisance, but it is quite the contrary-they will enable us to parti- 
tion state space, so that the dynamics can be better understood. 

Locally, the state space M looks like R^, meaning that a dynamical evolu- 
tion is an initial value problem, with d numbers sufficient to determine what will 
happen time t later. The local Euclidean structure at any given state space point 
X e At is described by a 'chart'. Globally, the state space may be a more compli- 
cated manifold such as a torus, a cylinder, or some other smooth geometric object. 
By manifold we mean a smooth differentiable (i-dimensional space which looks 
like R"^' only locally. For example, the state space of an autonomous Hamiltonian 
system the flow is confined to a constant energy hyper-surface. When we need to 
stress that the dimension J of Al is greater than one, we may refer to the point 
;c e A( as Xi where / = 1, 2, 3, . . . , J. If the dynamics is described by a set of PDEs 
(partial differential equations), the state space is the infinite dimensional function 
space. The evolution rule /' : A( ^ At tells us where a point is in At after a 
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Figure 2.2: The evolution rule /'can be used to map a 
region Mi of the state space into the region f'(Mi). 




time interval t. 



The pair {M, f) constitute a dynamical system. 



The dynamical systems we will be studying are smooth. This is expressed 
mathematically by saying that the evolution rule f can be differentiated as many 
times as needed. Its action on a point x is sometimes indicated by f{x, t) to remind 
us that / is really a function of two variables: the time and a point in state space. 
Note that time is relative rather than absolute, so only the time interval is neces- 
sary. This follows from the fact that a point in state space completely determines 
all future evolution, and it is not necessary to know anything besides the time 
interval. The time parameter can be a real variable {t e R), in which case the evo- 
lution is called a flow, or an integer (t e Z), in which case the evolution advances 
in discrete steps in time, given by iteration of a map. The evolution parameter 
need not be the physical time; for example, a time-stationary solution of a partial 
differential equation is parameterized by spatial variables. In such situations one 
talks of a 'spatial profile' rather than a 'flow'. 

Nature provides us with innumerable dynamical systems. They manifest them- 
selves through their trajectories: given a state xq at initial time to, the. flow map 

f : xq^ x{xq, t) 

yields the state x{t) time t later. This evolution rule traces out a sequence of 
points x{t) - /'(.To), the trajectory through the point xq = x{0). We shall usually 
omit the xq label from x{xo, t). By extension, we can also talk of the evolution 
of a region Mi of the state space. The language of continuum mechanics is quite 
helpful in visualizing such deformations, not only in 3-dimensional space, but also 
in state spaces of arbitrary dimension. Consider a motion / from the undeformed 
{reference or initial) region (a 'body') At, to the deformed {current or final) region 
Mf = f{Mi). We may write the motion as a map 



such that every xq in Mi is mapped to an x = /'(-To) in Mf, as in figure 2.2, where 
X denotes the state in the deformed region, and xq represents the state in the initial. 



/: Mi^Mf, 



(2.1) 



undeformed region. 



exercise 2.1 



flows -09apr20I3 



ChaosBook.org versionl4.4.I, Apr 21 2013 



CHAPTER 2. GO WITH THE FLOW 



Figure 2.3: A periodic point returns to the initial point 
after a finite time, x = f^'ix). Periodic orbit p is the 
set of periodic points p = Mp = [x\,X2, ■ ■ ■} swept out 
by the trajectory of any one of them in the finite time 



The subset of points Al.vo <^ At that belong to the infinite-time trajectory 
of a given point xq is called the orbit of xq; we shall talk about forward orbits, 
backward orbits, periodic orbits, etc.. For a flow, an orbit is a smooth continuous 
curve; for a map, it is a sequence of points. 'Trajectory' refers to a set of points or 
a curve segment traced out by x{t) up to time instant t. 'Orbit' refers to the totality 
of states that can be reached from xq, with state space M foliated into a union of 
such orbits (each Mxq labeled by a single point belonging to the set, xq = x{0) 
for example). Under time evolution a trajectory segment is mapped into another 
trajectory segment, but points within an orbit are only shifted; the orbit considered 
as a set is unchanged. Hence an orbit is a dynamically invariant notion. 

The central idea of ChaosBook is to replace the complicated, ergodic, asymp- 
totic f — > oo dynamics by a systematic hierarchy of compact time-invariant sets or 
compact orbits (equilibria, periodic orbits, invariant tori, • • •)• 

2.1.1 A classification of possible motions? 

What kinds of orbits are there? This is a grand question, and there are many 
answers. The following chapters offer some. Here is a first attempt to classify all 
possible orbits: 

stationary: f\x) - x for all t 

periodic: f{x) - /'^^''(x) for a given minimum period Tp 
aperiodic: f'{x)i=f\x) fovaWttt' . 

A periodic orbit (or a cycle) p is the set of points Mp c M swept out by a 
trajectory that returns to the initial point in a finite time. We refer to a point on a 
periodic orbit as a periodic point, see figure 2.3. Periodic orbits form a very small 
subset of the state space, in the same sense that rational numbers are a set of zero 
measure on the unit interval. 

Periodic orbits and equilibrium points are the simplest examples of 'non- 
wandering' invariant sets preserved by dynamics. Dynamics can also preserve 
higher-dimensional smooth compact invariant manifolds; most commonly en- 
countered are the M-dimensional tori of Hamiltonian dynamics, with the notion of 
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periodic motion generalized to quasiperiodic (the superposition of M incommen- 
surate frequencies) motion on a smooth torus, and families of solutions related 
by a continuous symmetry. Further examples are afforded by stable / unstable 
manifolds (a semi-infinite curve originating at an equilibrium along each stabil- 
ity eigenvector) and the most mysterious of all invariant orbits, the infinite time 
ergodic orbits. section 12.1 

The ancients tried to make sense of all dynamics in terms of periodic motions, 
epicycles, what we today call 'integrable systems'. The embarrassing truth is that 
for a generic dynamical system almost all motions are aperiodic. So we refine the 
classification by dividing aperiodic motions into two subtypes: those that wander 
off, and those that keep coming back. 

A point ;c € At is called a wandering point, if there exists an open neighbor- 
hood Mq of X to which the trajectory never returns 



In physics literature, the dynamics of such a state is often referred to as transient. 

Wandering points do not take part in the long-time dynamics, so your first task 
is to prune them from M as well as you can. What remains envelops the set of the 
long-time trajectories, or the non-wandering set. 

For times much longer than a typical 'turnover' time, it makes sense to relax 
the notion of exact periodicity and replace it by the notion of recurrence. A point 
is recurrent or non-wandering, if for any open neighborhood Alo of x and any 
time t,nin there exists a later time t, such that 



In other words, the trajectory of a non-wandering point reenters the neighborhood 
Afo infinitely often. We shall denote the non-wandering set of / by Q., i.e., the 
union of all the non-wandering points of M. This non-wandering set of / is key 
to understanding the long-time behavior of a dynamical system; all calculations 
undertaken here will be caiTied out on non-wandering sets. 

So much about individual trajectories. What about clouds of initial points? If 
there exists a connected state space volume that maps into itself under forward 
evolution (and you can prove that by the method of Lyapunov functional, or 
several other methods available in the literature), the flow is globally contracting 
onto a subset of M which we shall refer to as the attractor. The attractor may 
be unique, or there can coexist any number of distinct attracting sets, each with 
its own basin of attraction, the set of all points that fall into the attractor under 
forward evolution. The attractor can be a fixed point (a sink), a periodic orbit 
(a limit cycle), aperiodic, or any combination of the above. The most interesting 
case is that of an aperiodic recuiTcnt attractor, to which we shall refer loosely as a 



f\x) i Alo 



for all t > t, 



mm ■ 



(2.2) 



fix) e Mo. 



(2.3) 
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strange attractor. We say 'loosely', as will soon become apparent that diagnosing example 2.3 
and proving existence of a genuine, card-carrying strange attractor is a highly 
nontrivial undertaking; it requires explaining notions like "transitive" and "chain- 
recurrent" that we will be ready to discuss only in sect. 14.1. 

Conversely, if we can enclose the non-wandering set Q by a connected state 
space volume AIq and then show that almost all points within Alo, but not in O, 
eventually exit Mq, we refer to the non-wandering set Q as a repel ler. An example 
of a repeller is not hard to come by-the pinball game of sect. 1 .3 is a simple chaotic 
repeller. O, the non-wandering set of /, is the union of all of the above, separately 
invariant sets: attracting/repelling fixed points, strange attractors, repellers, etc.. 

It would seem, having said that the periodic points are so exceptional that 
almost all non-wandering points are aperiodic, that we have given up the ancients' 
fixation on periodic motions. Nothing could be further from truth. As longer and 
longer cycles approximate more and more accurately finite segments of aperiodic 
trajectories, we shall establish control over non-wandering sets by defining them 
as the closure of the union of all periodic points. 

Before we can work out an example of a non-wandering set and get a better 
grip on what chaotic motion might look like, we need to ponder flows in a little 
more depth. 



2.2 Flows 



Knowing the equations and knowing the solution are two 
different things. Far, far away. 
— T.D. Lee 

A flow is a continuous-time dynamical system. The evolution rule f is a family 
of mappings of At — > Al parameterized by ? e R. Because t represents a time 
interval, any family of mappings that forms an evolution rule must satisfy: exercise 2.2 

(a) f^{x) = X (in time there is no motion) 

(b) /'(/' (x)) = f**'{x) (the evolution law is the same at all times) 

(c) the mapping {x, t) i-^ f\x) from At x R into At is continuous. 

We shall often find it convenient to represent functional composition by 'o :' appendix 1.1 



(2.4) 



The family of mappings f{x) thus forms a continuous (forward semi-) group. 
Why 'semi-'group? It may fail to form a group if the dynamics is not reversible. 
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and the rule /'(x) cannot be used to rerun the dynamics backwards in time, with 
negative t; with no reversibility, we cannot define the inverse f^'{f{x)) - - 
X , in which case the family of mappings f'{x) does not form a group. In ex- 
ceedingly many situations of interest-for times beyond the Lyapunov time, for 
asymptotic attractors, for dissipative partial differential equations, for systems 
with noise, for non-invertible maps-the dynamics cannot be run backwards in 
time, hence, the circumspect emphasis on semigroups. On the other hand, there 
are many settings of physical interest, where dynamics is reversible (such as finite- 
dimensional Hamiltonian flows), and where the family of evolution maps /' does 
form a group. 

For infinitesimal times, flows can be defined by differential equations. We 
write a trajectory, a smooth curve embedded in the state space as 



xit + T)^f'^\xo)=f(fiXo,t),T) 



(2.5) 



and express the tangent to the curve at point x{t) as 



exercise 2.3 



dx 
dr 



r=0 



drfif{Xo,t),T)\,^0 = m, 



(2.6) 



the time derivative of the evolution rule, a vector evaluated at the point x{t). By 
considering all possible trajectories, we obtain the vector x{t) at any point x e M. 
This vector field is a (generaUzed) velocity field: remark 10.3 



x{t) - v{x) . 



(2.7) 



Newton's laws, Lagrange's method, or Hamilton's method are all familiar pro- 
cedures for obtaining a set of differential equations for the vector field v{x) that 
describes the evolution of a mechanical system. Equations of mechanics may ap- 
pear different in form from (2.7), as they are often involve higher time derivatives, 
but an equation that is second or higher order in time can always be rewritten as a 
set of first order equations. 

We are concerned here with a much larger world of general flows, mechanical 
or not, all defined by a time-independent vector field (2.7). At each point of the 
state space a vector indicates the local direction in which the trajectory evolves. 
The length of the vector |v(;c)| is proportional to the speed at the point x, and the 
direction and length of v(x) changes from point to point. When the state space is a 
complicated manifold embedded in M.^, one can no longer think of the vector field 
as being embedded in the state space. Instead, we have to imagine that each point 
X of state space has a different tangent plane TMx attached to it. The vector field 
lives in the union of all these tangent planes, a space called the tangent bundle 



TM 



U 



-veM 



flows -09apr20 13 



ChaosBook.org versioiil4.4.1, Apr 21 2013 



CHAPTER 2. GO WITH THE FLOW 



44 



Figure 2.4: (a) The 2-dimensional vector field for 
the Duffing system (2.8), together with a short tra- 
jectory segment, (b) The flow fines. Each 'comet' 
represents the same time interval of a trajectory, 
starting at the tail and ending at the head. The 
longer the comet, the faster the flow in that region. 



(a) 
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(b) 




TAIa: is called & fibre at .x, hence the whole thing is called the^^Z^re bundle. Locally 
a fibre bundle looks like the product of two 1.'^ spaces. Relax: we'll do our best 
not to use such words again. 



Example 2.1 A 2-dimensional vector field v(x): 
afforded by the unforced Duffing system 



A simple example of a flow is 



x(t) 
y(t) 



y(t) 



-0.15 y(t) + x(t)-x(ty 



(2.8) 



plotted in figure 2.4. The velocity vectors are drawn superimposed over the configura- 
tion coordinates ix{t),y{t)) of state space M, but they belong to a different space, the 
tangent bundle TM. 



The instantaneous velocity vector v is tangent to the trajectory, except at the 
equilibrium points, where it vanishes. 



If vixg) = 0, 



(2.9) 



Xq is also referred to as a stationary, fixed, critical, invariant, rest, stagnation 
point, zero of the vector field v, standing wave, stationary solution, or steady 
state. Our usage will be 'equilibrium' for a flow, 'fixed point' for a map. The 
trajectory remains forever stuck at Xq. Otherwise the trajectory passing thi^ough 
Xq at time t = can be obtained by integrating the equations (2.7): 



X{t) = f'iXo) ^ Xo-\- I dTV{x{T)) , X{0) ^ Xq . 

Jo 



(2.10) 



We shall consider here only autonomous flows, i.e., flows for which the velocity 
field Vi is stationary, not explicitly dependent on time. A non-autonomous system 



dy 

— ^ w{y, r) , 
dT 



(2.11) 



can always be converted into a system where time does not appear explicitly. exercise 2.4 

exercise 2.5 
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Figure 2.5: Lorenz "butterfly" strange attractor. (J. 
Halcrow) 
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To do so, extend ('suspend') state space to be (d + l)-dimensional by defining 
X = {y, t), with a stationary vector field 



v(x) 



w(y,T) 
1 



(2.12) 



The new flow x = vix) is autonomous, and the trajectory j(t) can be read off xit) 
by ignoring the last component of x. 

Example 2.2 Lorenz strange attractor: Edward Lorenz arrived at the equation 





X 




o-{y - x) 




X — v{x) — 


y 




px-y - xz 


(2.13) 




z 




xy-bz 





by a drastic simplification of tlie Rayleigii-Benard flow. Lorenz fixed o- - 10, b = 8/3, 
and varied the "Rayleigh number" p. For < p < I the equilibrium EQo - (0, 0, 0) at the 
origin is attractive. At p - I it undergoes a pitchfork bifurcation into a pair of equilibria 
at remark 2.3 



XEQ,, = (± ^Jbip-l), ± ylb{p-\),p - 1) , 



(2.14) 



We shall not explore the Lorenz flow dependence on the p parameter in what follows, 
but here is a brief synopsis: the EQo 1 -dimensional unstable manifold closes into a 
homoclinic orbit at p - 13.56 . . .. Beyond that, an infinity of associated periodic orbits 
are generated, until p = 24.74 . . ., where EQx i undergo a Hopf bifurcation. 

All computations that follow will be performed for the Lorenz parameter choice 
a- - 10, = 8/3, p = 28 . For these parameter values the long-time dynamics is confined 
to the strange attractor depicted in figure 2.5, and the positions of its equilibria are 
marked in figure 9.5. (continued in example 3.4) 



Example 2.3 Rossler strange attractor: The Duffing flow of figure 2.4 is bit of 
a bore-every trajectory ends up in one of the two attractive equilibrium points. Let's 
construct a flow that does not die out, but exhibits a recurrent dynamics. Start with a 
harmonic oscillator 



x^-y. 



y^x. 



(2.15) 
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Figure 2.6: A trajectory of the Rossler flow at time 
t = 250. (G. Simon) 




The solutions are re", re ", and the whole x-y plane rotates with constant angular 
velocity - I, period T = In. Now make the system unstable by adding 

X — —y , y — X + ay , a>0, (2.16) 

or, in radial coordinates, r - ar sin^ 6, - I + (a/2) sin 20. The plane is still rotating with 
the same average angular velocity, but trajectories are now spiraling out. Any flow in 
the plane either escapes, falls into an attracting equilibrium point, or converges to a limit 
cycle. Richer dynamics requires at least one more dimension. In order to prevent the 
trajectory from escaping to oo, kick it into 3rd dimension when x reaches some value c 
by adding 

Z = b + z{x-c), oO. (2.17) 

As X crosses c, z shoots upwards exponentially, z ^ e^"^"^'. In order to bring it back, 
start decreasing x by modifying its equation to 

X — —y — z . 

Large z drives the trajectory toward x = 0; there the exponential contraction by e^'" 
kicks in, and the trajectory drops back toward the x-y plane. This frequently studied 
example of an autonomous flow is called the Rossler flow 

X - -y- z 
y — X + ay 

z = b + zix-c), fl = /7 = 0.2, c = 5.7 (2.18) 

(for definitiveness, we fix the parameters a, b, c in what follows). The system&esm&e 2.8 
simple as they get-it would be linear, were it not for the sole bilinear term zx. Even for 
so 'simple' a system the nature of long-time solutions is far from obvious. 

There are two repelling equilibrium points (2.9): 

x± = {— + — ^Jl - 4ab/c~){c, —c/a, c/a) 

X- a {ab/c,—b/c,b/c) , x+ ^ {c,—c/a,c/a) 

{x-,y-,z-) = (0.0070,-0.0351,0.0351) 

(x+,y+,z+) = (5.6929,-28.464,28.464) (2.19) 

One is close to the origin by construction. The other, some distance away, exists be- 
cause the equilibrium condition has a 2nd-order nonlinearity. 
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To see what solutions look like in general, we need to resort to numerical in- 
tegration. A typical numerically integrated long-time trajectory is sketched in figure 2.6 
(see also figure 11.10). Trajectories that start out sufficiently close to the origin seem 
to converge to a strange attractor. We say 'seem' as there exists no proof thatesmdtBe 6.4 
an attractor is asymptotically aperiodic-it might well be that what we see is but a long 
transient on a way to an attractive periodic orbit. For now, accept that figure 2.6 and 
similar figures in what follows are examples of 'strange attractors.' (continued in 
exercise 2.8 and example 3.3) (R. Paskauskas) 

The Rossler flow is the simplest flow which exhibits many of the key aspects 
of chaotic dynamics; we shall use it and the 3-pinball (see chapter 8) systems 
throughout ChaosBook to motivate introduction of Poincare sections, return maps, 
symbolic dynamics, cycle expansions, and much else. Rossler flow is integrated 
in exercise 2.7, its equilibria are determined in exercise 2.8, its Poincare sections 
constructed in exercise 3.1, and the corresponding return Poincare map computed 
in exercise 3.2. Its volume contraction rate is computed in exercise 4.3, its topol- 
ogy investigated in exercise 4.4, the shortest Rossler flow cycles are computed and 
tabulated in exercise 13.10, and its Lyapunov exponents evaluated in exercise 6.5. 

2.2.1 Lagrangian and Eulerian viewpoints 

Continuum mechanics ofi'ers two profoundly different but mathematically equiva- 
lent ways to represent a given state space flow, the 'Lagrangian' and the 'Eulerian' 
viewpoints. From the Eulerian perspective one only cares about what is the state 
of system here and now; think of a field of grass, each grass blade the local ve- 
locity vector. From the Lagrangian viewpoint one cares about where a state space 
point come fromand where is it going to; think of the state space foliated into a 
bowl of linguini, each noodle an orbit, marked with a label xq somewhere along 
it. In the Eulerian formulation the flow is defined by specifying (2.7), the velocity 
field v{x). In the Lagrangian formulation it is given by the finite time flow (2.10), 
i.e., the totality of the trajectories x(t) comprising the deformed region, labeled by 
their origin xq in the initial undeformed region. If we mark the trajectory x(t) by 
its initial point xq, we are describing the flow in the Lagrangian coordinates. The 
Eulerian velocity v(x) at a fixed state space position x is equal to the Lagrangian 
velocity v{x{t)) at the trajectory passing through x at the instant t. Because /' is 
a single-valued function, any point on the trajectory can be used to label the tra- 
jectory. The transport of the 'material point' xq at ? = to its value at the current 
point x{t) = f'ixo) is a coordinate transformation from the Lagrangian coordinates 
to the Eulerian coordinates. 

In numerical work we are given the equations of motion (the local Eulerian 
velocity field v{x)), but we care about the solutions of these equations (the global 
Lagrangian flow). Conversely, in experimental work we observe ensembles of 
Lagrangian trajectories from which we then extract the velocity field (in fluid 
dynamics this is achieved by particle image velocimetry (PIV)). Once an Eulerian 
velocity field has been specified or extracted from the observational data, it is 
straightforward to compute the Lagrangian trajectories, objects of great practical 
interest in studies of long time dynamics, mixing, and transport. 
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fast track: 



chapter 3, p. 57 



2.3 Changing coordinates 

Problems are handed down to us in many shapes and forms, and they are not al- 
ways expressed in the most convenient way. In order to simplify a given problem, 
one may stretch, rotate, bend and mix the coordinates, but in doing so, the vector 
field will also change. The vector field lives in a (hyper)plane tangent to state 
space and changing the coordinates of state space affects the coordinates of the 
tangent space as well, in a way that we will now describe. 

Denote by h the conjugation function which maps the coordinates of the initial 
state space M into the reparameterized state space At' = h{Ai), with a point 
X e M related to a point y e At' by 

3; = h(x) = {yi{x),y2{x), . . .,yd{x)) . 

The change of coordinates must be one-to-one and span both At and At', so given 
any point y we can go back to x = h~^{y). For smooth flows the reparameterized 
dynamics should support the same number of derivatives as the initial one. If h is 
a (piecewise) analytic function, we refer to /j as a smooth conjugacy. 

The evolution rule g'Cvo) on AC can be computed from the evolution rule 
/'(xq) on At by taking the initial point yo e At', going back to At, evolving, and 
then mapping the final point x{t) back to At' : 



Here 'o' stands for functional composition h o f{x) - h{f{x)), so (2.20) is a 
shorthand for y{t) - h{f{h'^(yo))). 

The vector field x = v{x) is locally tangent to the flow it is related to the 
flow by differentiation (2.6) along the trajectory. The vector field j = w(y), y € At' 
locally tangent to g', follows by the chain rule: 



In order to rewrite the right-hand side as a function of y, note that the dy differen- 
tiation of h(h'^(y)) = y implies 



y{t)^g'(yo)-hofoh-'(yo). 



(2.20) 




= h\h-'(y))vih-'(y))=h\x)vix). 



(2.21) 



dh dh-^ 



= 1 




iy) 



(2.22) 




y 



dy 
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so the equations of motion in the transformed coordinates, with the indices rein- 
stated, ai^e 



yi ^ Wi(y) = 



dh 



4 



dy 



-(y) 



vj{h~'(y)). (2.23) 



Imagine the state space as a rubber sheet with the flow lines drawn on it. 
A coordinate change h corresponds to pulling and tugging on the rubber sheet 
smoothly, without cutting, gluing, or self-intersections of the distorted rubber 
sheet. Trajectories that are closed loops in M will remain closed loops in the 
new manifold M', but their shapes will change. Globally, h deforms the rubber 
sheet in a highly nonlinear manner, but locally it simply rescales and shears the 
tangent field by the Jacobian matrix djhi, yielding the simple transformation law 
(2.21) for the velocity fields. 

Time itself is a parametrization of points along flow lines, and it can also 
be reparameterized, s = s{t), with the concomitant modification of (2.23). An 
example is the 2-body collision regularization of the helium Hamiltonian (7.8), to 
be undertaken in appendix B.2 below. 



2.4 Computing trajectories 



On two occasions I have been asked [by members of Par- 
liament], 'Pray, Mr. Babbage, if you put into the machine 
wrong figures, will the right answers come out?' I am not 
able rightly to apprehend the kind of confusion of ideas 
that could provoke such a question. 
— Charles Babbage 

You have not learned dynamics unless you know how to integrate numerically 
whatever dynamical equations you face. Sooner or later, you need to implement 
some finite time-step prescription for integration of the equations of motion (2.7). 
The simplest is the Euler integrator which advances the trajectory by 6t x velocity 
at each time step: 

Xi — > Xi + Vi{x) 6t . (2.24) 

This might suffice to get you started, but as soon as you need higher numerical ac- 
curacy, you will need something better. There are many excellent reference texts 
and computer programs that can help you learn how to solve differential equations 
numerically using sophisticated numerical tools, such as pseudo-spectral methods 
or implicit methods. If a 'sophisticated' integration routine takes days and gob- exercise 
bles up terabits of memory, you are using brain-damaged high level softwai^e. Try 
writing a few lines of your own Runge-Kutta code in some mundane everyday 
language. While you absolutely need to master the requisite numerical methods, exercise 
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this is neither the time nor the place to expound upon them; how you learn them is 

your business. And if you have developed some nice routines for solving problems exercise 2.9 

in this text or can point another student to some, let us know. exercise 2.10 



Resume 



Chaotic dynamics with a low-dimensional attractor can be visualized as a suc- 
cession of nearly periodic but unstable motions. In the same spirit, turbulence in 
spatially extended systems can be described in terms of recurrent spatiotemporal 
patterns. Pictorially, dynamics drives a given spatially extended system through 
a repertoire of unstable patterns; as we watch a turbulent system evolve, every so 
often we catch a glimpse of a familiar pattern. For any finite spatial resolution 
and finite time, the system follows approximately a pattern belonging to a finite 
repertoire of possible patterns. The long-term dynamics can be thought of as a 
waUc through the space of such patterns. Recasting this image into mathematics is 
the subject of this book. 



Commentary 



Remark 2.1 'State space' or 'phase space?' In ChaosBook, state space is the set 
of admissible states in a general d- or oo -dimensional dynamical system. The term phase 
space is reserved for Hamiltonian state spaces of 2D-dimensions, where D is the number 
of Hamiltonian degrees of freedom. If the state space is a continuous smooth manifold 
much of the literature [?, 2.12] refers to it as 'phase space,' but we find the control engi- 
neering usage sharper: in the state space (or 'time-domain') description of an autonomous 
physical system, the state of the system is represented as a vector within the 'state space,' 
space whose axes are the state variables, and the evolution of a state is given by differ- 
ential equations which are first-order in time. Hopf [2.11] would refer to such a state as 
an 'instantaneous phase' of the system obeying a 'differential law of the phase motion'. 
The distinction made here is needed in a text where one treats deterministic dynami- 
cal systems, stochastic systems and quantum-mechanical systems. The term 'phase' has 
a precise meaning in wave mechanics, quantum mechanics and dynamics of integrable 
systems at the heart of Hamilton's formulation of Newtonian mechanics, while 'state 
space' is more descriptive of the way the notion is used in the general theory of dynami- 
cal systems. Further confusion arises when prefix spatio- as in 'spatiotemporal' is used in 
reference to states extended in the (1, 2, or 3-dimensional) physical configuration space. 
They may exhibit spatial wave-like behaviors, but their state space is c» -dimensional. 

Much of the literature denotes the vector field in a first order differential equation 
(2.7) by f{x) or F(x) or even X{x), and its integral for time t by the 'time-f forward map' 
or 'flow map' x(xo, t) - <t>{xo, f), or 0,(xo), or something else. Here we treat maps and 
flows on an equal footing, and we save Greek letters for matters quantum-mechanical. We 
reserve the notation fix) for maps such as (2.10) and refer to a state space velocity vector 
field as v{x). We come to regret this choice very far into the text, only by the time we 
delve into Navier-Stokes equations. 
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Remark 2.2 Rossler and Duffing flows. The Duffing system (2.8) arises in the study 
of electronic circuits [2.4]. The Rossler flow (2.18) is the simplest flow which exhibits 
many of the key aspects of chaotic dynamics. It was introduced in ref. [2.5] as a set of 
equations describing no particular physical system, but capturing the essence of Lorenz 
chaos in the most simple of smooth flows. Otto Rossler, a man of classical education, was 
inspired in this quest by that rarely cited grandfather of chaos, Anaxagoras (456 B.C.). 
This and references to earlier work can be found in refs. [2.6, 2.7, 2.8]. We recommend 
in particular the inimitable Abraham and Shaw illustrated classic [2.9] for its beautiful 
sketches of many flows, including the Rossler flow. Timothy Jones [2.10] has a number 
of interesting simulations on a Drexel website. 

Remark 2.3 Lorenz equation. The Lorenz equation (2. 13) is the most celebrated early 
illustration of "deterministic chaos" [2.12] (but not the first - that honor goes to Dame 
Cartwright [2.13]). Lorenz's paper, which can be found in reprint collections refs. [2.14, 
2.15], is a pleasure to read, and it is still one of the best introductions to the physics mo- 
tivating such models. For a geophysics derivation, see Rothman course notes [2.16]. The 
equations, a set of ODEs in E?, exhibit strange attractors. W. Tucker [2.17, 2.18, 2.19] 
has proven rigorously via interval arithmetic that the Lorenz attractor is strange for the 
original parameters (no stable orbits and that it has a long stable periodic orbit for slightly 
different parameters. In contrast to the hyperbolic strange attractors such as the weakly 
perturbed cat map, the Lorenz attractor is structurally unstable. Fr0yland [2.20] has a 
nice brief discussion of Lorenz flow. Fr0yland and Alfsen [2.21] plot many periodic 
and heteroclinic orbits of the Lorenz flow; some of the symmetric ones are included 
in ref. [2.20]. Guckenheimer- Williams [2.22] and Afraimovich-Bykov-Shilnikov [2.23] 
offer an in-depth discussion of the Lorenz equation. The most detailed study of the 
Lorenz equation was undertaken by Sparrow [2.24]. For a physical interpretation of p 
as "Rayleigh number," see Jackson [2.25] and Seydel [2.26]. The Lorenz truncation to 
3 modes is so drastic that the model bears no relation to the geophysical hydrodynamics 
problem that motivated it. For a detailed pictures of Lorenz invariant manifolds consult 
Vol II of Jackson [2.25]. The Lorenz attractor is a very thin fractal - as we saw, stable 
manifold thickness is of the order lO"'* - whose fractal structure has been accurately re- 
solved by D. Viswanath [2.27, 2.28]. If you wonder what analytic function theory has to 
say about Lorenz, check ref. [2.29] . Refs. [2.30, 2.3 1] might also be of interest, (contin- 
ued in remark 9.2) 

Remark 2.4 Diagnosing cliaos. In sect. 1.3.1 we have stated that a determin- 

istic system exhibits 'chaos' if its trajectories are locally unstable (positive Lyapunov 
exponent) and globally mixing (positive entropy). In sect. 6.2 we shall define Lyapunov 
exponents and discuss their evaluation, but already at this point it would be handy to have 
a few quick numerical methods to diagnose chaotic dynamics. Laskafs frequency anal- 
ysis method [2.32] is useful for extracting quasi-periodic and weakly chaotic regions of 
state space in Hamiltonian dynamics with many degrees of freedom. For pointers to other 
numerical methods, see ref. [2.33]. 

Remark 2.5 Dynamical systems software: J.D. Meiss [2.34] has maintained for 
many years Sci.nonlinear FAQ which is now in part superseded by the SIAM Dynami- 
cal Systems website www . dynamicalsystems . org. The website glossary contains most 
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of Meiss's FAQ plus new ones, as well as an up-to-date software list [2.35] with links 
to DSTool, xpp, AUTO, etc.. Springer on-line Encyclopaedia of Mathematics main- 
tains links to dynamical systems software packages on eom.springerde/D/dl30210.htm. 
Kuznetsov [1.14] Appendix D.9 gives an exhaustive overview of software available in 
2004. (see also remark 12.1) 
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The exercises that you should do have underlined titles . The rest (smaller type) 

are optional. Difficult problems ai^e marked by any number of *** stai^s. 



Exercises 



2.1. Trajectories do not intersect. A trajectory in the 
state space Ai is the set of points one gets by evolving 
X e Ai forwards and backwards in time: 

= {y € M : fix) =y for f 6 R) . 

Show that if two trajectories intersect, then they are the 
same curve. 

2.2. Evolution as a group. The trajectory evolution f is 
a one-parameter semigroup, where (2.4) 

Show that it is a commutative semigroup. 

In this case, the commutative character of the semi- 
group of evolution functions comes from the commuta- 
tive character of the time parameter under addition. Can 
you think of any other semigroup replacing time? 

2.3. Almost ODE'S. 

(a) Consider the point on R evolving according 
X = e'' . Is this an ordinary differential equation? 

(b) Is i = x(x(t)) an ordinary differential equation? 

(c) What about x - x{t+ 1)1 

2.4. All equilibrium points are fixed points. Show that 
a point of a vector field v where the velocity is zero is a 
fixed point of the dynamics /'. 

2.5. Gradient systems. Gradient systems (or 'potential 
problems') are a simple class of dynamical systems for 
which the velocity field is given by the gradient of an 
auxiliary function, the 'potential' (p 

X = -V0(jc) 

where x € R'', and is a function from that space to the 
reals R. 

(a) Show that the velocity of the particle is in the di- 
rection of most rapid decrease of the function (p. 

(b) Show that all extrema of are fixed points of the 
flow. 



(c) Show that it takes an infinite amount of time for 
the system to reach an equilibrium point. 

(d) Show that there are no periodic orbits in gradient 
systems. 

2.6. Runge-Kutta integration. Implement the fourth- 
order Runge-Kutta integration formula (see, for exam- 
ple, ref. [2.36]) for x = v(x): 

ki k2 ki k4 , 

6 3 3 6 
^1 - 6Tv(xn), k2 - 6tv{x„ + kill) 

ki — 6tv{Xi, + k2/2) 

k4 — 6t v{x„ + kj) . 

If you already know your Runge-Kutta, program what 
you believe to be a better numerical integration routine, 
and explain what is better about it. 

2.7. Rossler flow. Use the result of exercise 2.6 or some 
other integration routine to integrate numerically the 
Rossler flow (2.18). Does the result look like a 'strange 
attractor' ? 

2.8. Equilibria of the Rossler flow. 

(a) Find all equilibrium points {xq,yq,Zq) of the 
Rossler system (2.18). How many are there? 

(b) Assume that b - a. As we shall see, some surpris- 
ingly large, and surprisingly small numbers arise 
in this system. In order to understand their size, 
introduce parameters 

e = fl/c , D = 1 - 4e\ = (1 + Vd)/2 . 

Express all the equilibria in terms of (c, e, D, p"^), 
expand to the first order in e, and evaluate for 
a - b - 0.2, c - 5.7 in (2.18). In the case stud- 
ied e » 0.03, so these estimates are quite accurate, 
(continued in exercise 3.1) 

(Rytis Paskauskas) 

2.9. Can you integrate me? Integrating equations nu- 
merically is not for the faint of heart. It is not always 
possible to establish that a set of nonlinear ordinary 
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differential equations has a solution for all times and 
there are many cases were the solution only exists for 
a limited time interval, as, for example, for the equation 
i = jc^ , x(0) = 1 . 

(a) For what times do solutions of 

X - x{x{t)) 

exist? Do you need a numerical routine to answer 
this question? 

(b) Let's test the integrator you wrote in exercise 2.6. 
The equation x = -x with initial conditions x{Q) = 
2 and i = has the solution x{t) - e"'(l + e^') • 
Can your integrator reproduce this solution for the 
interval t 6 [0, 10]? Check your solution by plot- 
ting the error as compared to the exact result. 

(c) Now we will try something a little harder. The 
equation is going to be third order 

X +0.6x + i - |x| + 1 = , 

which can be checked-numerically-to be chaotic. 
For initial conditions, we will always use i(0) = 
x(0) - x(0) - . Can you reproduce the re- 
sult Jt:(12) = 0.8462071873 (all digits are sig- 
nificant)? Even though the equation being inte- 
grated is chaotic, the time intervals are not long 
enough for the exponential separation of trajecto- 
ries to be noticeable (the exponential growth fac- 
tor is ^ 2.4). 

(d) Determine the time interval for which the solution 
of X = x^, x{Q) = 1 exists. 

2.10. Classical collinear helium dynamics. In order to ap- 
ply periodic orbit theory to quantization of helium we 



shall need to compute classical periodic orbits of the he- 
lium system. In this exercise we commence their evalu- 
ation for the collinear helium atom (7.8) 



1 



1 



H^-P\ + -P2 + 

2 2 r\ r2 r\ 



1 



ri 



The nuclear charge for helium is Z = 2. Colinear he- 
lium has only 3 degrees of freedom and the dynamics 
can be visualized as a motion in the (ri , r2), ri > quad- 
rant. In (ri , r2)-coordinates the potential is singular for 
r, — > nucleus-electron collisions. These 2-body col- 
lisions can be regularized by rescaling the coordinates, 
with details given in sect. B.2. In the transformed coor- 
dinates {x\ ,X2,pi, p2) the Hamiltonian equations of mo- 
tion take the form 



= 221 



Pi = 222 



p- 

pi Ql 

2-11-22(1 + % 
8 ' 



Ql = \p^Ql^ Qi^\PiQ\- 



(2.25) 



where /? = (2t + 22) 



2n1/2 



(a) Integrate the equations of motion by the fourth or- 
der Runge-Kutta computer routine of exercise 2.6 
(or whatever integration routine you like). A 
convenient way to visualize the 3 -dimensional 
state space orbit is by projecting it onto the 2- 
dimensional (ri(f), ?"2(f)) plane, (continued in ex- 
ercise 3.4) 

(Gregor Tanner, Per Rosenqvist) 
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